Reliability of brain atrophy measurements in multiple sclerosis using MRI: an assessment of six freely available software packages for cross-sectional analyses

PURPOSE: Volume measurement using MRI is important to assess brain atrophy in multiple sclerosis (MS). However, differences between scanners, acquisition protocols, and analysis software introduce unwanted variability of volumes. To quantify theses effects, we compared within-scanner repeatability and between-scanner reproducibility of three different MR scanners for six brain segmentation methods. METHODS: Twenty-one people with MS underwent scanning and rescanning on three 3 T MR scanners (GE MR750, Philips Ingenuity, Toshiba Vantage Titan) to obtain 3D T1-weighted images. FreeSurfer, FSL, SAMSEG, FastSurfer, CAT-12, and SynthSeg were used to quantify brain, white matter and (deep) gray matter volumes both from lesion-filled and non-lesion-filled 3D T1-weighted images. We used intra-class correlation coefficient (ICC) to quantify agreement; repeated-measures ANOVA to analyze systematic differences; and variance component analysis to quantify the standard error of measurement (SEM) and smallest detectable change (SDC). RESULTS: For all six software, both between-scanner agreement (ICCs ranging 0.4–1) and within-scanner agreement (ICC range: 0.6–1) were typically good, and good to excellent (ICC > 0.7) for large structures. No clear differences were found between filled and non-filled images. However, gray and white matter volumes did differ systematically between scanners for all software (p < 0.05). Variance component analysis yielded within-scanner SDC ranging from 1.02% (SAMSEG, whole-brain) to 14.55% (FreeSurfer, CSF); and between-scanner SDC ranging from 4.83% (SynthSeg, thalamus) to 29.25% (CAT12, thalamus). CONCLUSION: Volume measurements of brain, GM and WM showed high repeatability, and high reproducibility despite substantial differences between scanners. Smallest detectable change was high, especially between different scanners, which hampers the clinical implementation of atrophy measurements

Quantification of Cervical Cord Cross-Sectional Area: Which Acquisition, Vertebra Level, and Analysis Software? A Multicenter Repeatability Study on a Traveling Healthy Volunteer

Atrofia; Área transversal; Médula espinalAtròfia; Àrea transversal; Medul·la espinalAtrophy; Cross-sectional area; Spinal cordBackground: Considerable spinal cord (SC) atrophy occurs in multiple sclerosis (MS). While MRI-based techniques for SC cross-sectional area (CSA) quantification have improved over time, there is no common agreement on whether to measure at single vertebral levels or across larger regions and whether upper SC CSA can be reliably measured from brain images. Aim: To compare in a multicenter setting three CSA measurement methods in terms of repeatability at different anatomical levels. To analyze the agreement between measurements performed on the cervical cord and on brain MRI. Method: One healthy volunteer was scanned three times on the same day in six sites (three scanner vendors) using a 3T MRI protocol including sagittal 3D T1-weighted imaging of the brain (covering the upper cervical cord) and of the SC. Images were analyzed using two semiautomated methods [NeuroQLab (NQL) and the Active Surface Model (ASM)] and the fully automated Spinal Cord Toolbox (SCT) on different vertebral levels (C1–C2; C2/3) on SC and brain images and the entire cervical cord (C1–C7) on SC images only. Results: CSA estimates were significantly smaller using SCT compared to NQL and ASM (p < 0.001), regardless of the cord level. Inter-scanner repeatability was best in C1–C7: coefficients of variation for NQL, ASM, and SCT: 0.4, 0.6, and 1.0%, respectively. CSAs estimated in brain MRI were slightly lower than in SC MRI (all p ≤ 0.006 at the C1–C2 level). Despite protocol harmonization between the centers with regard to image resolution and use of high-contrast 3D T1-weighted sequences, the variability of CSA was partly scanner dependent probably due to differences in scanner geometry, coil design, and details of the MRI parameter settings. Conclusion: For CSA quantification, dedicated isotropic SC MRI should be acquired, which yielded best repeatability in the entire cervical cord. In the upper part of the cervical cord, use of brain MRI scans entailed only a minor loss of CSA repeatability compared to SC MRI. Due to systematic differences between scanners and the CSA quantification software, both should be kept constant within a study. The MRI dataset of this study is available publicly to test new analysis approaches.Parts of this work were funded by the German Federal Ministry for Education and Research, BMBF, German Competence Network Multiple Sclerosis KKNMS (Grant Nos. 01GI1601I and 01GI0914) and by grants from the UK MS Society. FP, CG, and MY were supported by the National Institute for Health Research (NIHR) University College London Hospitals Biomedical Research Center. The funding institutions did not interfere with the study design, the collection, analysis and interpretation of data, the writing of the report, or the decision to submit the article for publication

The effect of gadolinium-based contrast-agents on automated brain atrophy measurements by FreeSurfer in patients with multiple sclerosis

Objective To determine whether reliable brain atrophy measures can be obtained from post-contrast 3D T1-weighted images in patients with multiple sclerosis (MS) using FreeSurfer. Methods Twenty-two patients with MS were included, in which 3D T1-weighted MR images were obtained during the same scanner visit, with the same acquisition protocol, before and after administration of gadolinium-based contrast agents (GBCAs). Two FreeSurfer versions (v.6.0.1 and v.7.1.1.) were applied to calculate grey matter (GM) and white matter (WM) volumes and global and regional cortical thickness. The consistency between measures obtained in pre- and post-contrast images was assessed by intra-class correlation coefficient (ICC), the difference was investigated by paired t-tests, and the mean percentage increase or decrease was calculated for total WM and GM matter volume, total deep GM and thalamus volume, and mean cortical thickness. Results Good to excellent reliability was found between all investigated measures, with ICC ranging from 0.926 to 0.996, all p values < 0.001. GM volumes and cortical thickness measurements were significantly higher in post-contrast images by 3.1 to 17.4%, while total WM volume decreased significantly by 1.7% (all p values < 0.001). Conclusion The consistency between values obtained from pre- and post-contrast images was excellent, suggesting it may be possible to extract reliable brain atrophy measurements from T1-weighted images acquired after administration of GBCAs, using FreeSurfer. However, absolute values were systematically different between pre- and post-contrast images, meaning that such images should not be compared directly. Potential systematic effects, possibly dependent on GBCA dose or the delay time after contrast injection, should be investigated.publishedVersio

Tau pathology as determinant of changes in atrophy and cerebral blood flow: a multi-modal longitudinal imaging study

PURPOSE: Tau pathology is associated with concurrent atrophy and decreased cerebral blood flow (CBF) in Alzheimer's disease (AD), but less is known about their temporal relationships. Our aim was therefore to investigate the association of concurrent and longitudinal tau PET with longitudinal changes in atrophy and relative CBF. METHODS: We included 61 individuals from the Amsterdam Dementia Cohort (mean age 65.1 ± 7.5 years, 44% female, 57% amyloid-β positive [Aβ +], 26 cognitively impaired [CI]) who underwent dynamic [18F]flortaucipir PET and structural MRI at baseline and 25 ± 5 months follow-up. In addition, we included 86 individuals (68 CI) who only underwent baseline dynamic [18F]flortaucipir PET and MRI scans to increase power in our statistical models. We obtained [18F]flortaucipir PET binding potential (BPND) and R1 values reflecting tau load and relative CBF, respectively, and computed cortical thickness from the structural MRI scans using FreeSurfer. We assessed the regional associations between i) baseline and ii) annual change in tau PET BPND in Braak I, III/IV, and V/VI regions and cortical thickness or R1 in cortical gray matter regions (spanning the whole brain) over time using linear mixed models with random intercepts adjusted for age, sex, time between baseline and follow-up assessments, and baseline BPND in case of analyses with annual change as determinant. All analyses were performed in Aβ-  cognitively normal (CN) individuals and Aβ+  (CN and CI) individuals separately. RESULTS: In Aβ+ individuals, greater baseline Braak III/IV and V/VI tau PET binding was associated with faster cortical thinning in primarily frontotemporal regions. Annual changes in tau PET were not associated with cortical thinning over time in either Aβ+ or Aβ-  individuals. Baseline tau PET was not associated with longitudinal changes in relative CBF, but increases in Braak III/IV tau PET over time were associated with increases in parietal relative CBF over time in Aβ + individuals. CONCLUSION: We showed that higher tau load was related to accelerated cortical thinning, but not to decreases in relative CBF. Moreover, tau PET load at baseline was a stronger predictor of cortical thinning than change of tau PET signal

The Effect of Smoking on Long-term Gray Matter Atrophy and Clinical Disability in Patients with Relapsing-Remitting Multiple Sclerosis

The relationship between smoking, long-term brain atrophy, and clinical disability in patients with multiple sclerosis (MS) is unclear. Here, we assessed long-term effects of smoking by evaluating MRI and clinical outcome measures after 10 years in smoking and nonsmoking patients with relapsing-remitting MS (RRMS).publishedVersio

Serum neurofilament as a predictor of 10-year grey matter atrophy and clinical disability in multiple sclerosis: a longitudinal study

Background The predictive value of serum neurofilament light chain (sNfL) on long-term prognosis in multiple sclerosis (MS) is still unclear. Objective Investigate the relation between sNfL levels over a 2-year period in patients with relapsing-remitting MS, and clinical disability and grey matter (GM) atrophy after 10 years. Methods 85 patients, originally enrolled in a multicentre, randomised trial of ω−3 fatty acids, participated in a 10-year follow-up visit. sNfL levels were measured by Simoa quarterly until month 12, and then at month 24. The appearance of new gadolinium-enhancing (Gd+) lesions was assessed monthly between baseline and month 9, and then at months 12 and 24. At the 10-year follow-up visit, brain atrophy measures were obtained using FreeSurfer. Results Higher mean sNfL levels during early periods of active inflammation (Gd+ lesions present or recently present) predicted lower total (β=−0.399, p=0.040) and deep (β=−0.556, p=0.010) GM volume, lower mean cortical thickness (β=−0.581, p=0.010) and higher T2 lesion count (β=0.498, p=0.018). Of the clinical outcomes, higher inflammatory sNfL levels were associated with higher disability measured by the dominant hand Nine-Hole Peg Test (β=0.593, p=0.004). Mean sNfL levels during periods of remission (no Gd+ lesions present or recently present) did not predict GM atrophy or disability progression. Conclusion Higher sNfL levels during periods of active inflammation predicted more GM atrophy and specific aspects of clinical disability 10 years later. The findings suggest that subsequent long-term GM atrophy is mainly due to neuroaxonal degradation within new lesions.publishedVersio

Manual and automated tissue segmentation confirm the impact of thalamus atrophy on cognition in multiple sclerosis : A multicenter study

Thalamus atrophy has been linked to cognitive decline in multiple sclerosis (MS) using various segmentation methods. We investigated the consistency of the association between thalamus volume and cognition in MS for two common automated segmentation approaches, as well as fully manual outlining. Standardized neuropsychological assessment and 3-Tesla 3D-T1-weighted brain MRI were collected (multi-center) from 57 MS patients and 17 healthy controls. Thalamus segmentations were generated manually and using five automated methods. Agreement between the algorithms and manual outlines was assessed with Bland-Altman plots; linear regression assessed the presence of proportional bias. The effect of segmentation method on the separation of cognitively impaired (CI) and preserved (CP) patients was investigated through Generalized Estimating Equations; associations with cognitive measures were investigated using linear mixed models, for each method and vendor. In smaller thalami, automated methods systematically overestimated volumes compared to manual segmentations [ ρ =(-0.42)-(-0.76); p- values < 0.001). All methods significantly distinguished CI from CP MS patients, except manual outlines of the left thalamus (p = 0.23). Poorer global neuropsychological test performance was significantly associated with smaller thalamus volumes bilaterally using all methods. Vendor significantly affected the findings. Automated and manual thalamus segmentation consistently demonstrated an association between thalamus atrophy and cognitive impairment in MS. However, a proportional bias in smaller thalami and choice of MRI acquisition system might impact the effect size of these findings

The sequence of structural, functional and cognitive changes in multiple sclerosis

Background: As disease progression remains poorly understood in multiple sclerosis (MS), we aim to investigate the sequence in which different disease milestones occur using a novel data-driven approach. Methods: We analysed a cohort of 295 relapse-onset MS patients and 96 healthy controls, and considered 28 features, capturing information on T2-lesion load, regional brain and spinal cord volumes, resting-state functional centrality (“hubness”), microstructural tissue integrity of major white matter (WM) tracts and performance on multiple cognitive tests. We used a discriminative event-based model to estimate the sequence of biomarker abnormality in MS progression in general, as well as specific models for worsening physical disability and cognitive impairment. Results: We demonstrated that grey matter (GM) atrophy of the cerebellum, thalamus, and changes in corticospinal tracts are early events in MS pathology, whereas other WM tracts as well as the cognitive domains of working memory, attention, and executive function are consistently late events. The models for disability and cognition show early functional changes of the default-mode network and earlier changes in spinal cord volume compared to the general MS population. Overall, GM atrophy seems crucial due to its early involvement in the disease course, whereas WM tract integrity appears to be affected relatively late despite the early onset of WM lesions. Conclusion: Data-driven modelling revealed the relative occurrence of both imaging and non-imaging events as MS progresses, providing insights into disease propagation mechanisms, and allowing fine-grained staging of patients for monitoring purpose

Cost-performance trade-offs in haptic hardware design

The objective of this research was to determine whether low performance haptic hardware leads to the same surgical task performance compared to more expensive hardware in a virtual reality surgical simulator for laparoscopy. VR surgical simulators are currently being introduced in leading teaching hospitals around the world. While they provide great potential for improvement over current laparoscopic skills training methods, a major barrier to large-scale acceptance is their high cost. Therefore this study is performed to determine whether a reduction in quality and therefore cost can be obtained without affecting surgical task performance. To perform user test at different levels of haptic quality, we developed software that can introduce friction, cogging, force saturation, inertia, and backlash into the haptic loop, simulating the characteristics of less expensive hardware on a high-end haptic interface. This software avoids the need for an expensive hardware redesign, while it allows varying the different parameters on a continuous scale, independent from each other, and within a realistic range. In a pilot study expert surgeons performed a clip application (2 participants) and a dissection task (3 participants) on commercial haptic hardware and VR laparoscopic software. Each surgeon performed the task(s) 3 times under 5 different settings while forces and kinematic data were recorded. Two settings were picked from the ones mentioned above; the other three consisted of the unaltered high fidelity setting, zero force feedback, and a combination of force saturation, cogging, friction, and inertia. We compared tissue-interaction forces, velocities, tool-tip path lengths, and completion times between the high fidelity setting and each of the other 7 settings. At a significance level of 0.05 a Friedman test showed that only the no force feedback condition was significantly different from the high fidelity condition in applied 95 percentile forces. In the clip application task both 50 percentile, and 95 percentile forces were significantly different in the no force feedback condition compared to high fidelity. None of the other settings showed significant differences in any of the performance measures. These preliminary results suggest that low performance components can be used in haptic hardware for laparoscopy without affecting task performance, potentially creating a significant cost reduction.Applied Science, Faculty ofMechanical Engineering, Department ofGraduat